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RATE SHAPING IN PER-FLOW OUTPUT 
QUEUED ROUTING MECHANISMS FOR 
UNSPECIFIED BIT RATE SERVICE 

Pursuant to 35 U.S.C.120, the priority of the inventors' 
earlier filed provisional application filed on Jun. 27, 1996 
under Ser. No. 60/020,643 is claimed. 

I. FIELD OF THE INVENTION 

This invention relates to packet switched communication 
networks and, more particularly, to traffic shaping for caus- 
ing the time multiplexed packet flows at queuing points 
within such networks or network elements to conform to 
specified traffic descriptors. 



Partially overlapping sets of ATM traffic classes have 
been defined by the Telecommunications Standardization 
Sector of the International Telecommunications Union 
(TTU-T) and the ATM Forum. In some instances, traffic 
classes which have essentially identical attributes have been 
given different names by these two groups, so the following 
name translation table identifies the existing equivalent 
counterparts: 



10 



mJ-T Traffic Class 



ATM Forum Traffic Class 



II. CROSS REFERENCES TO RELATED 
APPLICATIONS 

For other concurrent filings on traffic shaping see appli- 
cation Ser. No. 08/872,327 now U.S. Pat. No. 6,064,677 by 
Christopher J. Kappler et ah, entitled "Multiple Rate Sen- 
sitive Priority Queues for Reducing Relative Data Transport 
Unit Delay Variations in Time Multiplexed Outputs from 
Output Queued Routing Mechanisms," application Ser. No. 
08/872,756 now U.S. PaL No. 6,064,651 by Landis C. 
Rogers et aL, entitled "Rate Shaping in Per-Flow Output 
Queued Routing Mechanisms for Statistical Bit Rate 
Service," U.S. Pat. No. 5,926,459 entitled "Rate Shaping in 
Per-Flow Queued Routing Mechanisms for Available Bit 
Rate Service," by Joseph B. Lyles et aL, application Ser. No. 
08/868,287 now U.S. Pat. No. 6,038,217 entitle "Rate Shap- 
ing in Per-Flow Output Queued Routing Mechanisms for 
Available Bit Rate (ABR) Service in Networks Having 
Segmented ABR Control Loops," by Joseph B. Lyles, appli- 
cation Ser. No. 08/873,064 now U.S. Pat. No. 6,064,650 
entitled "Rate Shaping in Per-Flow Output Queued Routing 
Mechanisms Having Output Links Servicing Multiple 
Physical Layers" by Christopher J. Kappler et al. 

III. BACKGROUND OF THE INVENTION 
A. Traffic Contracts/Definitions 

Most applications that are currently running on packet 
switched communication networks can function acceptably 
with whatever bandwidth they happen to obtain from the 
network because they have "elastic" bandwidth require- 
ments. The service classes that support these applications is 
known as "best efforts" service in the Internet community 
and as "Available Bit Rate" (ABR) in the Broadband ISDN/ 
ATM community. 

There is, however, a growing demand for network ser- 
vices that provide bounded jitter or, in other words, bounded 
packet delay variation (commonly referred to as cell delay 
variation in an ATM context). For example, this type of 
service is required for real time applications, such as circuit 
emulation and video. It is not clear whether and how the 
Internet community will respond to this demand, but the 
Broadband ISDN/ATM community has responded by intro- 
ducing the notion of a user-network negotiated traffic con- 
tract. 

As is known, a user-network ATM contract is defined by 
a traffic descriptor which includes traffic parameters, toler- 
ances and quality of service requirements. A conformance 
definition is specified for each of the relevant traffic param- 
eters. Accordingly, ATM services may make use of these 
traffic parameters and their corresponding conformance 
specifications to support different combinations of Quality 
of Service (QoS) objectives and multiplexing schemes. 
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ABR 

Deterministic Bit Rate (DBR) 
Statistical Bit Rate (SBR) 
(No existing counterpart, but 
understudy) 

(No existing counterpart, bul 
understudy) 



ABR 

Constant Bit Rate (CBR) 
Variable Bit Rate (VBR) 
Real time Variable Bit Rate (rt-VBR) 

Unspecified Bit Rate (UBR) 



20 An ATM service contract for a virtual circuit (VC) con- 
nection or a virtual path (VP) connection may include 
multiple parameters describing the service rate of the con- 
nection. This includes the Peak Cell Rate (PCR), the Sus- 
tainable Cell Rate (SCR) the Intrinsic Burst Tolerance 0BT), 

25 and the Minimum Cell Rate (MCR). Not all of these 
parameters are relevant for every connection or every ser- 
vice class, but when they are implied or explicitly specified 
elements of the service contract, they must be respected. VC 
connections are the primary focus of the following 

30 discussion, but it will be understood the VP connections can 
also be so specified. The data transport unit for an ATM 
connection usually is referred to as a "cell." In this 
disclosure, however, the term "packet" is sometimes used to 
refer to the data transport unit because this more general 

35 terminology is consistent with some of the broader aspects 
of the innovations. 

The Generic Cell Rate Algorithm (GCRA), which is 
specified in ITU-T Recommendation 1.371, is well suited for 
testing a packet or cell flow for conformance with a traffic 

40 descriptor. To perform such testing, the GCRA requires the 
specification of an emission interval (i.e., the reciprocal of a 
flow rate) and a tolerance, t. In practice, this tolerance may 
depend on a variety of factors, including the connection, the 
connection setup parameters, or the class of service. As will 

45 be seen, the GCRA can be employed as a Boolean function, 
where for a flow of fixed size packets or cells on a 
connection, the GCRA (emission interval, tolerance) is false 
if the flow is conforming to a peak rate or true if the flow is 
conforming to a minimum rate. For example, a source of 

50 cells conforms to a PCR if GCRA (1/PCR, t^) is false. 
Likewise, a connection or flow conforms to an MCR if 
GCRA (1/MCR, t mc ^) is false. As will be appreciated the 
"emission interval" is the reciprocal of the "cell rate." 
A DBR traffic contract is appropriate for a source which 

55 establishes a connection in the expectation that a static 
amount of bandwidth will be continuously available to the 
connection throughout its lifetime. Thus, the bandwidth the 
network commits to a DBR connection is characterized by 
a PCR value. Further, the cell or packet flow on such a 

60 connection complies with the traffic contract if it conforms 
to GCRA (1/PCR, Xp^j). On the other hand, an SBR traffic 
contract is suitable for an application which has known 
traffic characteristics that allow for an informed selection of 
an SCR and x WT> as well as a PCR and An SBR or 

65 rt-SBR flow complies with its traffic contract if the flow not 
only conforms to GCRA (1/PCR, but also to GCRA 

(1/SCR, x IBT \ 
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As previously indicated, an ABR traffic contract is appro- the traffic characteristics achieved by shaping, whilst 
priate for applications that can tolerate the dynamic varia- meeting QoS objectives and subsequent conform- 
tions in the information transfer rate that result from the use ance tests at the network or network segment egress, 
of unreserved bandwidth. A PCR and an MCR are specified Traffic shaping may also be used within the customer 
by the source establishing such a connection, and these 5 equipment or at the source in order to ensure that the 
parameters may be subject to negotiation with the network. cells generated by the source or at the UNI are con- 
Thus, the bandwidth that is available on an ABR connection forming to the negotiated traffic contract relevant to the 
is the sum of the MCR (which can be 0) and a variable cell ^TC that is used (see Section 5.5)." ITU-T Recom- 
rate that results from a sharing of unreserved bandwidth mendation 1371, Section 6.2.5. 
among ABR connections via a defined allocation policy (i.e., 10 c * Scheduling for Real Time and Non-Real Time 
the bandwidth a source receives above its specified MCR Connections/Existing Tools and Techniques 
depends not only on the negotiated PCR, but also on As is known, if bandwidm is not divided "fairly" between 
network policy). Feedback from the network enables the a PPjj^f employing "best efforts" Internet service or 
source application to dynamically adjust the rate it feeds ABR AJTV1 service a variety of undesirable phenomena may 
cells or packets into an ABR coDnection. An ABR flow 15 °.<* ur r Se f ^IhocZ; Lykj Shenker and Zhang, "Conges- 
, r r . &on Control for Best-Effort Service: Why we need a new 
£K ™KT * traffic contract if it conforms to paradigm IEEE Networ k, January/Febr/ary 1996, for fur- 
GCRA (1/MCR, and isalways non-compliant if it ^ ^ QQ mechanisms for be ^ t e ffort/ABR traffic, 
does not conform to GCRA (1/PCR, x^). Conformance in Most ATM switches currently are implemented with FIFO 
theregionbetweenMCRandPCRisdependentontheABR queuing> FIF0 queuing cxhibits penological behaviors 
feedback and is thus dynamically determined. 20 when used for ABR traffic (see "On Traffic Phase Effects in 
A UBR traffic contract is similar to the ABR contract, Packet-Switched Gateways", Sally Floyd and Van Jacobson, 
except that the UBR contract does not accommodate the Internetworking: Research and Experience, Vol. 3, pp. 
specification of an MCR and has no dynamic conformance 115-156 (1992), and "Observations on the Dynamics of a 
definition. Therefore, a UBR flow complies with its traffic Congestion Control Algorithm: The effects of Two-Way 
contract if it conforms to GCRA (1/PCR, x^). 25 Traffic", Uxia Zhang, Scott Shenker, and David Clark, A CA/ 
B. Traffic Shaping Sigcomm 91 Conference, Sep. 3-6, 1991, Zurich, 
ITU-T Recommendation 1.371 addresses the possibility of Switzerland, pp. 133-148.). FIFO also is unable to protect 
reshaping traffic at a network element for the purpose of correctly behaving users against misbehaving users (it does 
bringing the traffic into conformance with a traffic descriptor not provide isolation). As a result of these deficiencies 
in the following terms: 30 non-FIFO queuing mechanisms such as weighted fair queu- 
"Traffic shaping is a mechanism that alters the traffic for example, A. Demers, S. Keshave, and S. 
characteristics of a stream of cells on a VCC or a VPC Shenker, "Analysis and Simulation of a Fair Queuing 
to achieve a desired modification of those traffic Algorithm," Proceedings of ACM SigComm, pages 1-12, 
characteristics, in order to achieve better network effi- September 1989; and A. K. Parekh "A Generalized Proces- 
ciency whilst meeting the QoS objectives or to ensure 35 sor sharm S Approach to Flow Control in Integrated Service 
conformance at a subsequent interface. Traffic shaping Networks," Ph.D. Thesis, Department of Electrical Engi- 
niust maintain cell sequence integrity on an ATM neering and Computer Science, MIT, 1992.) or approxima- 
connection. Shaping modifies traffic characteristics of a uons t0 fair queuing such as round-robin (Ellen L. Hahne, 
cell flow with the consequence of increasing the mean "Round-robin Scheduling for Max-Min Fairness in Data 
cell transfer delay. 40 Networks," IEEE Journal on Selected Areas in 
Examples of traffic shaping are peak cell rate reduction, Communications, Vol. 9, pp. 1024-1039, September 1991.) 
burst length limiting, reduction of CDV by suitably are often suggested. 

spacing cells in time and queue service schemes. Servic r e classes which have inelastic bandwidth require- 

Itisanetworkoperator'schoicetodeterminewhetherand m< * ats f™*^ ^ ***** ^ 0Ugh f he 

where traffic shaping is performed. As an example, a 45 " e work ^ J lltc /" ^ ^ unded f ^ ° r P**? 

network operator may choose to perform traffic shaping dela y vanat ™| shown by the above referenced Parekh 

in conjunction with suitable UPC/NPC functions. ?5* r L wcl ^ tcd fa * *w™8 ; caQ be used to provide bounded 

Ti . 4 , ^ , * «- . • J lttcr tor real tune streams. Moreover, Parekh s results have 

1 ZZnT S Ute™ n to ^ 0rm 8 ° n recently (Pawan Shaoa s - ^ and Harrick M - Vk - 

P ggreS 5 0 "Determining End-to-End Delay Bounds in Heterogeneous 

As a consequence, any ATM connection may be subject to Net works," Proceedings of The 5th International Workshop 

traffic shaping. on Network and Operating System Support for Digital Audio 

The options available to the network operator/service ^ video (NOSSDAV), Durham, N. H., Apr. 18-22, 1995.) 

provider are the following: been extended to prove delay bounds for systems using the 

a. No shaping 55 closely related mechanisms of Virtual Clock (lixia Zhang, 
Dimension the network in order to accommodate any « Virtual Clock: ANew Traffic Control Algorithm for Packet 

flow of conforming cells at the network ingress Switching Networks," Proceedings of ACM SigComm, 

whilst ensuring conformance at the network egress pages 19-29, August 1990.) and Self-clocked Fair Queuing 

without any shaping function. (S. J. Golestani, "A Self-Clocked Fair Queuing Scheme for 

b. Shaping 60 High Speed Applications," Proceedings ofWFOCOM, pp. 
Dimension and operate the network so that any flow of 636-646, 1994). 

conforming cells at the ingress is conveyed by the Thus, it is known that both elastic (Best effort/ABR) and 

network or network segment whilst meeting QoS inelastic (or real-time) services can benefit from the use of 

objectives and apply output shaping the traffic in fair queuing and related algorithms, 

order to meet conformance tests at the egress. 65 1. Weighted Fair Queuing and Virtual Clock 

Shape the traffic at the ingress of the network or Fair queuing and related algorithms (e.g., frame-based 

network segment and allocate resources according to fair queuing, deficit round robin, etc.) operate on sequences 
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of packets or other data transport units (e.g., an ATM cell is 
a packet. For ATM these sequences are identified by either 
the VQ or the VPI, while in the Internet protocol suite the 
identification is on the basis of <IP address, protocol, 
port>triples (IPv4) or flow identifiers (IPv6). In both self- 
clocked weighted fair queuing and virtual clock, packets are 
ordered (sorted) by timestamps (schemes such as round- 
robin provide approximations to ordering of packets by 
timestamps). These timestamps represent the virtual finish- 
ing time (or equivalently the virtual starting time for the 
packet and are computed by taking a starting time value and 
adding an offset obtained by multiplying the length of the 
packet by a weight which represents the particular packet 
sequence's share of the bandwidth. 

More particularly, for virtual clock the virtual finishing 
time is computed as: 

V7ft o)=o 

V7tf /+l)=ma)t{AniYal(£ VT(f, /)}+LengthGS /+1)/Rate0) (1) 

where: 

VT(f, j) is the virtual finishing time associated with packet 

j of flow (virtual circuit) f ; 
Arrival(f, j) is the arrival time of packet j of flow f; and 
Length(f, j) is the length of packet j of flow f. 
Self-clocked weighted fair queuing assigns virtual finish- 
ing times according to the formula: 

VTft o)=o 

VT(f, /+l)=inax{SystcmVirtualTunc, VJ\f f /)}+Length(£ 

/+l)*weighttf) (2) 

where: 

SystemVfirtualTime is the virtual time associated with the 
packet being served (being output) at the time packet(f , 
j+1) arrives. 

For ATM the packet length is constant because the cells 
are of fixed size (i.e., 53 bytes long). Consequently, right- 
most term in both Expression (1) and Expression (2) 
becomes a per flow constant. For virtual clock the simplified 
expression is: 

VT(f, /+l)=max{ArrivalO; VT(f, ;0}+constant(/) (3) 

For self-clocked weighted fair queuing, on the other hand, 
the simplified expression is: 

VT(f, /+l)-max{SystemVirtualTune, VT(f, /)}+constant (f) (4) 

In other words, an ATM queuing point which implements 
either virtual clock or self-<:locked weighted fair queuing 
performs the following steps: 

1) compute the maximum of (a) the current virtual time 
for the VC, and (b) either of i) the arrival time of the 
cell or ii) the system virtual time. 

2) add to the results of step 1 above a per-VC constant 
representing that VC's share of the bandwidth. 

3) service cells (transmit them) in order of increasing 
values of the virtual time stamps assigned by steps 1 
and 2. 

2. Priority 

Giving priority to one traffic class over another means that 
if the higher priority traffic class has cells ready for 
transmission, those cells are always transmitted in prefer- 
ence to the cells of the lower priority traffic class. 

Priority mechanisms can be either preemptive or non- 
preemptive. This terminology comes from the operating 



,583 Bl 

6 

system literature. A non-preemptive priority mechanism 
assigns a priority to an object (a process in the operating 
system world, a VC in the ATM world) at a scheduling time, 
and the object then retains this priority until it is served. 
5 Preemptive priority mechanisms, on the other hand, can 
change the priority of objects while they are waiting to be 
served. For example, in a preemptive system one could say 
"schedule this VC with priority 3 but if it is not served within 
200 microseconds then increase its priority up to 2." 
10 3. Work Conserving and Non-work Conserving Queuing 
Kleinrock, Queuing Systems, Vol. 2: Computer 
Applications, John Wiley & Sons, N.Y., N.Y. 1996, p. 113 
uses the terminology "work conserving" to denote any 
queuing system in which work is neither created nor 
15 destroyed. In keeping with this terminology a switch which, 
when given queued cells, always transmits cells on the 
outgoing link is a "work conserving switch". Switches 
employing a pure FIFO, weighted fair queuing or virtual 
clock scheduling algorithm are all work conserving. In 
20 contrast, a non-work conserving switch may choose not to 
send cells, even when cells are queued for transmission. As 
will be seen, a method of doing this is to program the switch 
to wait until the current time is equal to or greater than the 
timestamp associated with a particular cell before transmit- 
25 ting that cell. 

Work conserving switches attempt to fully utilize the 
transmission link, but do not necessarily remove or prevent 
bursts. In contrast, non-work conserving switches can stra- 
tegically delay cells so as to re-shape traffic to meet a more 
30 stringent conformance test (i.e., a GCRA with a smaller x). 
Additionally, a non-work conserving switch in which a 
given connection is only allocated a specified amount of 
buffering can perform a policing function (in ITU terms a 
UPC/NPC) by discarding or tagging cells which overflow 
35 the allotted buffer space. An example of a non-work con- 
serving queuing system is the Stalled Virtual Clock (Sugih 
Jamin, "Stalled Virtual Clock" working note, Department of 
Computer Science, UCLA, Mar. 21, 1994), which is an 
adaptation of Lixia Zhang's Virtual Clock algorithm where 
40 virtual time is not allowed to run faster (it stalls or goes 
non-work conserving) than real-time. Also see, work by 
Scott Shenker that is available by FTP at FTP.PARC.X- 
EROX.com. 
4. Calendar Queues 
45 A calendar queue is a time ordered list of actions, each of 
which is dequeued and executed when real-time is equal to 
or greater than the time associated with the action. Calendar 
queues with bounded time intervals can be represented as a 
linear array which is known as a "time-wheel" or "lime- 
50 line." Tune -wheels assign events to buckets relative to a 
pointer, where the bucket index is calculated using arith- 
metic modulo the wheel size. These data structures are well 
known in the literature as a queuing mechanism. In a 
time-wheel, absolute time is represented as an offset relative 
55 to the current time ("real time"), and each element in the 
array is a bucket which contains one or more actions 
(typically in linked-list form) which are to be executed at the 
time assigned to the bucket in which they reside. Any of the 
buckets of such a time-wheel can be empty, i.e., have no 
60 events associated with it. 

For every time-wheel, there are two times of interest: 
U«« and X latesn which correspond to the head and tail 
pointers for the active entries in the array; where i eartiest is 
the time of the next entry (e.g., packet or cell) to be serviced, 
6S and tj^, is the time associated with the latest (most distant 
in time) bucket containing a scheduled event. The difference 
between t earliest and t, fl(rj( cannot be greater than the length 
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of the lime-wheel, b, minus 1. This can be ensured by FIG. 1 is a simplified block diagram of an ATM switch in 

viewing the time as being kept modulo b, and by then which the present invention may be used to advantage; 

ensuring that no offset (the packet length multiplied bv either n^, -* «- «■ ,, 4 , t , . 

the rate or the weight in virtual clock or weighted fair ™* I *^*atoctfy various shapes an 

queuing respectively) is greater than b-1. For an ATM link , *™ ^11 may suitably take while traversing the switch 

running at OC-3 speeds (149.76 mbps— the SONET payload snown m FIG " 1; 

rate) there are approximately 353208 cells/sec on the link. ^G. 3 is a more detailed block diagram of a representa- 

Accorchngly, if 64 Kbps (voice telephony rates) flows tive channel on the output or transmit side of the chip shown 

(approximately 174 cells/sec when AAL type 1 is used) are in FIG. 1; 

the lowest speed connections that need to be supported, then FIG. 4 schematically illustrates a stalled virtual clock 

the ratio of the highest supported rate to the lowest rate is calendar queue implementation of the present invention: 

2029, which rounds up to 2". This ratio is the maximum m ^ - . „ ... 4 4 . A , . 

oflset that wUl get added during the calculation of virtual , ™" f ^ hema **Uy illustrates another stalled virtual 

times. Therefore, a time-wheel of length 2030 (2048 to allow clock catendar 1 ueue implementation of the invention; 

for rounding up to a power of two) is sufficient to encode the FIG - & schematically illustrates still another stalled virtual 

virtual times associated with circuits ranging in rates from is clock calendar queue implementation of this invention; 

64 Kbps to full OC-3 link rate. FIG. 7 schematically illustrates an ABR connection hav- 

The length of a time-wheel array can be decreased by ing a source-to-destination control loop; and 

permitting an array element to contain more than one time mG 8 schematically illustrates an ABR connection hav- 

onset. For example, if the above -described time-wheel is • a segmented control loon 

reduced to 256 elements from 2048, then each bucket would 20 

have eight time offsets mapped into it. Actions within a VI. DETAILED DESCRIPTION OF THE 

single bucket that spans multiple offsets may be performed INVENTION 
out of order, but between buckets actions will stay in order. 

This reduces the amount of memory that needs to be While the invention is described in some detail herein- 
allocated to such a time-wheel at the cost of reducing the 25 below with specific reference to certain embodiments, it is 
precision of the ordering of actions in the calendar queue. to t> e understood that there is no intent to limit it to those 

D. Traffic Shaping for Time Multiplexed Flows on Mul- embodiments. On the contrary, the intent is to cover all 

tiple Output Channels modifications, alternatives and equivalents falling within the 

Preferably, any traffic shaping that is needed to bring time spirit and scope of the invention as defined by the appended 

multiplexed packet or cell flows into conformance with their claims. 

traffic contracts is performed after the completion of all 30 ^ A Representative Environment 

switching or routing operations that are required to separate ~ . , , 

flows fof different output channels from each other This burning now to the oxawings, and at this point especially 

permits the throughput efficiency of the multiplexer to be to ™- 1, the input and output ports of an ATM switch 21 

optimized. typically are coupled to one or more physical layers via 

However, prior output queued ATM switches generally 35 respective Utopia 2 interfaces and to a switch control 

have employed FIFO (First In-First Out) output buffers. processor module 22 via a second suitable interface. This 

These buffers are not capable of participating in a controlled enables the switch 21 to exchange data and control cells with 

reshaping of any of the flows that pass through them. anv physical layers that are connected to them, and to also 

Instead, the per-VC time multiplexed flows that are output exchange control cells with the control processor module 22. 

by these buffers essentially are time multiplexed composites 40 In keeping with standard practices, the communication 

of the input flows that are loaded into them. Of course, these channels are unidirectional, so a pair of channels are 

output flows are time delayed relative to the input flows required for bi-directional communications, 

because of the inherent latency of the buffers. Moreover, the switch 21 comp rises a switching fabric 24, a fabric 

cell delay variation (CDV) of one or more of these output control modulc 25 and a reservation ring 26 for switching 

flows may be increased if schedufing conflicts occur among 45 daU and COQtrol cells from m ^ qucues t0 r . vc out t 

the data transport hurts. of the differen flows because these ^ ^ iQ tfaese d ^ d * 

conflicts cause so-called "transmit collisions. - , t ~- , ^ t , : y 

As will be appreciated, increased CDV is especially m data m * m0rV ' T and output queues are 

troublesome for traffic, such as DBR traffic, which generally mana S ed £ a ^ «>ntro module 28. Typically^he data 

has a relatively tight tolerance. Thus, if each hop between a memorv 27 15 sized to hold U P to 12000 cells - 

source and a destination includes a simple FIFO output 50 Connectl0n records for the data and control cell flows are 

queue of the foregoing type, it may be necessary to limit the stored m ^ P at h in control memory 29, together 

number of hops this CDV sensitive traffic is permitted to tv pes of control cells which are intercepted by 

make in order to ensure compliance within its specified a rate based engine and traffic multiplexer 31 for routing to 

tolerance. the control processor module 22. Suitably, the control RAM 

Accordingly, there is a need for more efficient and more 55 29 is capable of accommodating up to about 8200 connec- 

effective traffic shaping mechanisms and processes for ATM tion records and 64 k cell records. The interaction of the 

switches and other routers that route traffic from multiple control processor module 22 with the switch 21 is beyond 

inputs to multiple outputs for time multiplexed output emis- the scope of the present invention and, therefore, is not 

sion. described herein. However, persons who are familiar with 

IV. SUMMARY OF THE INVENTION 60 A ™ switch design will understand that the control proces- 

rp.- . . . a _ . sor is primarily responsible for performing connection estab- 

Tms invention provides rate shaping in per-flow output . « A \ \ r „ 7Ta\ , 

j r . . c -a * * lishment and termination, as well as OAM (Operation and 

queued routing mechanisms for unspecified bit rate service. Maintenance) functions ^ 

V. BRIEF DESCRIPTION OF THE DRAWINGS The data path of the switch 21 is synchronously clocked 

Still further objects and advantages of this invention will 65 (by means not shown) at a predetermined rate of, say, 40 

be evident when the following details and description is read MHz. However, in keeping with conventional synchronous 

in conjunction with the attached drawings, in which: pipeline design practices, the phase of this clock signal is 
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delayed (by means also not shown) by differing amounts at 
different points along the data path to give the data adequate 
time to settle prior to being transferred from one pipelined 
stage to the next. 

In accordance with standard practices, a source wishing to 5 
communicate with a destination initiates negotiations with 
the ATM network within which the switch 21 resides by 
sending a SETUP message to the network. This message 
identifies the destination and explicitly or impliedly specifies 
all of the relevant traffic parameters for the requested con* 1Q 
nection. If the network is prepared to commit to the traffic 
contract which is defined by these traffic parameters (or a 
modified version of the parameters that the source is willing 
to accept), the network routes the SETUP message to the 
destination. Then, if the destination is ready to receive 
message traffic from the source in accordance with the terms 
of the traffic contract, the destination returns a CONNECT 
message to the source. This CONNECT message confirms 
that a connection has been established on a specified virtual 
circuit (VC) within a specified virtual path (VP) for a cell 
flow that conforms to the traffic contract. See ITU-T Rec- 20 
ommendation 0.2391 and ATM Forum UNI 4.0 Specifica- 
tion. "Permanent" virtual connections can be established by 
provisioning, without invoking these signaling protocols. 

Data cells begin to flow after a connection is established. 25 
As shown in FIG. 2, the form of the cells change as they pass 
through the switch 21 because of the operations the switch 
performs. Cells may be replicated within the switch 21 for 
multicasting, but the following discussion will be limited to 
unicast operations to avoid unnecessary complexity. 3Q 

As indicated in FIG. 2 at 41, each inbound cell that the 
switch 21 receives has a header containing a VP index and 
a VC index. These indices combine to define a unique 
address for one hop of the connection. A connection may be 
composed of multiple hops, so the VP and VC indices for the 35 
next hoop are written into the header of the cell as it passes 
through the switch 21 as indicated in FIG. 2 at 42. 

The switch 21 employs the VP and VC indices of the 
inbound cell (FIG. 2 at 41) to compute the address at which 
the connection record for the associated flow resides within 40 
the control RAM 29. Typically, this connection record 
includes a bit vector for identifying the output port (i.e., the 
switch-level "destination") at which the flow exits the switch 
21, a priority index for identifying the relative priority of the 
flow on a granular priority scale, and a circuit index 45 
("Circuit Index") which uniquely identifies the flow inter- 
nally of the switch 21. As shown in FIG. 2 at 43, these 
connection parameters are written into the cell header. Then, 
the cell is written into the data RAM memory 27, while a 
pointer to the cell is linked into an appropriate one of a 50 
plurality of FIFO input queues, where the selection of the 
queue is based on the priority of the related flow. 

The relative priorities of the head of queue cells within 
these input queues are examined during each cell time, and 
the head of queue cell having the highest priority is selected 55 
for arbitration during the next arbitration session. 
Furthermore, the priority of any lower priority head of queue 
cell (i.e., any non-selected head of queue cell) is incremen- 
tally increased (by means not shown), thereby increasing the 
probability of that cell being selected for arbitration during go 
the next arbitration session. Therefore, even though the 
higher priority input queues have greater throughput per unit 
time than the lower priority queues, the lower priority 
queues have bounded delay because the priority of their 
head of queue cells increases as a function of time. 65 

Each arbitration cycle requires one cell time of the switch 
21, so the routing information for the cells that are selected 



for arbitration is fed into the reservation ring 26 one cell time 
prior to the release into the switching fabric 24 of the pay 
loads of the cell or cells that win the arbitration. In other 
words, as shown in FIG. 2 at 44, the cells that are received 
by the reservation ring 26 and switching fabric 24 are 
composed of the headers of the cells for the next arbitration 
cycle (i.e., the "current cells") followed by the bodies or 
payloads of the cells successfully arbitrated during the 
previous arbitration cycle (ie., the "previous cells"). Thus, 
when the cell bodies reach the fabric 24, the fabric is already 
configured by the fabric control 25 to route those cells to 
their respective output port destination. For additional infor- 
mation on the reservation ring 26 and the arbitration it 
performs, see Cisneros, A., "Large Packet Switch and Con- 
tention Resolution Device," Proceedings of the XIII Inter- 
national Switching Symposium, 1990, paper 14, Vol. Ill, pp. 
77-83 and Lyles U.S. Pat. No. 5,519,698, which issued May 
21, 1996. 

In the illustrated embodiment, cells are decomposed into 
four bit wide nibbles for arbitration and routing. Thereafter 
(with the exception of "idle cells" that may be provided for 
testing the switching processes) the cells are reassembled 
and queued in the data path, the control path, or both (a) for 
time scheduled transfer to the appropriate output ports of the 
switch 21 and/or (b) for transfer to the control processor 
module 22. The time scheduled transfer of cells to the output 
ports of the switch 21 is central to this invention so that 
subject is discussed in further detail hereinbelow. On the 
other hand, the decomposition and reassembly of the cells, 
the testing processes, and the interaction of the control 
processor 22 with RM (Resource Management) and OAM 
(Operation and Maintenance) cells are incidental topics 
which need not be considered in depth. 

Referring to FIG. 3, it will be understood that the switch 
21 fans out on the output or transmit side of the switching 
fabric 24. Thus, while one output channel of the switch 21 
is shown, it will be understood that this channel is generally 
representative of the other channels. 

As shown, there suitably is a fill cells module 51 for 
accepting cell bodies and their associated circuit indices 
from the switching fabric 24. The "effective cell time" on the 
output side of the switching fabric 24 is determined by the 
ratio of the nominal cell time to the "k" speed-up factor. 
Thus, for example, if the nominal cell time is 113 clock 
cycles/cell, the effective cell time on the output side of the 
switching fabric 24 is 56.5 cycles/cell if k=»2. 

When a valid cell is received, the fill cell module 51 
typically uses cell structures from a linked and numbered 
free list 52 of such data structures for writing the cell into the 
data memory 27. To that end, the fill cell module 51 suitably 
includes a fetch state machine 53 for fetching cell structures 
from the top of the free list 52 on demand. This enables the 
fill cell module 51 to insert the circuit index for the cell and 
a pointer to the location of the cell in data memory 27 into 
an "arrival" message that it sends to notify a cell flow control 
unit 55 of the cell's arrival The circuit index enables the 
flow control unit 55 to ascertain the VC or flow to which the 
cell belongs from the connection record in the control 
memory 29. This, in turn, enables the cell flow control unit 
55 to check the traffic shaping status of the flow. An 
OAM/RM recognizer 57 advantageously is provided to 
enable the flow control unit 55 to identify these control cells 
and to determine whether they are to be queued in the data 
path, the control path, or both. 

The memory pointers for cells of traffic contract compli- 
ant flows are queued in per-VC queues in response to 
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"addCelT messages which the cell flow coDtrol unit 55 such as ATM cells, from an output queued routing mecha- 

sends to a queue control unit 58. Each addCell message nism to specified peak data unit flow rates, such as PCRs for 

identifies the cell to which it pertains and the circuit index DBR/CBR ATM service. As previously described, the data 

for the associated flow or VC. Moreover, the addCell transport units of the flows that are routed to a given output 

message also indicates whether the cell is to be queued in the 5 port are queued, after being routed, in per-flow queues. The 

data path, the control path, or both. When the cell has been data transport units at the heads of these queues then are 

appropriately queue, the queue control unit 58 returns an admitted by an admission controller 61 (to the exclusion of 

"added" message to the cell flow control unit 55 for noti- all other transport units) for scheduling on a time line 

fying the flow control unit 55 that the newly queued cell calendar queue 63 by a scheduler 62. The scheduler 62, in 
needs to be taken into account during future rate shaping 10 turn, performs per-flow virtual clock computations on these 

computations on the VC to which it belongs. head of queue transport units to schedule them for release 

Advantageously, the queue control unit 58 monitors the fr° m tbe calendar queue 63 in accordance with their respec- 

length of the per-VC queues with respect to the depth control ave theoretical finish times, VT(f, j+1), or their respective 

limits that are set on the respective queues. This enables the theoretical start times. Please see Section IH.C.4 above, 
control unit 58 to initiate congestion control action on ABR 15 Real time advantageously is incremented on the time line 

flows when their per-VC queues become excessively long. It 63 at a rate that enables the shaped, time multiplexed output 

also permits the control unit 58 to identify flows that are traffic to essentially fill the bandwidth of the output link 71. 

exceeding their traffic contract so that an appropriate polic- As will be recalled, the maximum number of resolvable time 

ing function (not shown) can be invoked to drop or log cells slots into which the scheduler 62 can map the head of queue 
of such non-compliant flows. 20 members of the respective flows is based on the ratio of the 

An admission controller 61 monitors the "added" mes- maximum permissible frequency to the minimum perm is- 

sages that are returned by the queue control unit 58 to cause sible frequency of those flows. Thus, the rate at which real 

a scheduler 62 to schedule the head of queue cells for the nme is incremented from bucket-to-bucket is a rationale 

non-empty per-VC queues on a calendar queue 63 for multiple of the cell rate. 

transmission at scheduled times. Suitably, the scheduler 62 25 Data transport units residing in time slots which represent 

employs a per-VC virtual clock to schedule these head of times that are earlier than or equal to the current real time of 

queue cells on the calendar queue 63 in accordance with reference for the time line 63 are eligible for transmission 

respective virtual finishing times, VT(f, j+1), that the sched- and, therefore, are linked into a transport list 65 as previ- 

uler 62 computes for them (or, alternatively, "virtual start ously described. However, those data transport units which 

times"). Please see Section III.C.l above. 30 reside in time slots that are associated with later time slots 

The calendar queue 63 tracks system "real time" or of me time fine 63 remain in a pending state until system real 

"current time" to prevent any of the scheduled cells from time advances sufficiently to reach those time slots. To avoid 

being released for transmission prior to its scheduled time. rollover ambiguities, the time line 63 is designed to ensure 

In other words, the scheduler 62 and the calendar queue 63 35 that all references to earlier scheduled data transport limits 

implement a stalled virtual clock so that the cells that are are removed from each time slot before any references to 

scheduled for transmission are released for transmission later scheduled transport units are inserted therein in antici- 

only when system real time has at least reached their pation of the next scan. 

respective scheduled transmission times. As illustrated, con- While the above-described arrangement effectively 
nections having cells that have been released for transmis- ^ shapes conforming DBR/CBR ATM flows to the PCRs 
sion by the calendar queue 63 are linked into a link list of specified by their traffic contracts, it does not aid in bringing 
connections that have cells ready for transmission on a the Cell Delay Variation (CDVs) of those flows into con- 
transmit list 65. formity with the parameters of their traffic contracts. 

The calendar queue 63 notifies the flow control unit 55 C. Multiple Priority Levels for Minimizing Relative CDV 

whenever it releases a cell for transmission on any given 45 In accordance ^ me t mvention> data traDsport 

connection. The flow control unit 55, m turn requests the units mat are dclivcred to a multi lexin int> ^ J m 

reference to the next cell (i.e., the new head of queue cell) out t rt of an ^ g ffc^ h aving mcttni 

if any, on the per-VC queue : for ^the jpven connection and frcquencies , m priori tized so that the data transport units of 

notifies the admission controUer 61 that it should admit this me ^ f flows are ^ ^ ovef 

reference to the scheduler 62 for scheduling. Thus, the 50 any data transport umts of lower frequency flows with which 

admission controller oi etrectiveiy engages in closed loop m h to collidCt M ^ QWQ 

in FIG. 3, this transmit 

communicator with the calendar queue 63 to ensure that riorit can ^ implemented by steeri me data t rt 

Oie head of queue ceUs which it admits for scheduling units mat are admiHed for \ a ^ ^ 

thereon are admitted to the exclusion of all other cells in the clock xbeduiiag mec banism 63 or the like to one or another 

per-VC queues. Tims, tbe calendar queue 63 may be imple- S5 of , luralit of ^ ^ 0Hjered (ime . lines QI 

mented by employing one or more time bounded tune- output FIFO queues based on the frequencies of the flows to 

wheels or Ume hnes, 66. Please see SecUon III.C.4 above. which mose ^ daU ^ be , Fof 

The ume span of these time-wheels must be at least as long e j for M ^ switch it ^ advisaWe **^ fc . 

as the period of the lowest frequency flows that the system me nt on the order of five different frequency dependent/class 

* des,gned to support to prevent time wrap mduced amb.- M of d dem ou ^ ut ^ ^JT (1) 

guities and preferab y is twice as long so relative tunes can priority for ^ from flows ^ have negotiated * u | put rat( £ 

be compared using two s complement computations. of at Ieast Vif of the m rate of ^ * u|put ^ ^ ^ 

B. Shapmg Flows of Fixed Bit Length Data Transport aggregate bandwidth), (2) a second priority for cells form 

Limits to Specified Peak Flow Rates flows having negotiated output rates ranging from Vie to V*ss 

Referring to FIG. 4, it will be evident that stalled virtual 65 of the output link rate, and (3) a third priority for cells from 

clock tr ansmis s i on control is well suited for shaping time flows having negotiated output rates ranging from V4s<s to 

multiplexed flows of fixed bit length data transport units, V«S6 of the link rate. The lower two priorities then suitably 
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are established for ABR connections that have non-zero of the ABR flows to be GCRA (1/MCR, x MCR ) non- 
negotiated MCR rates and for UBR connections and ABR compliant (or just barely compliant) and GCRA (1/PCR, 
connections that have MCR rates of 0, respectively. x pcr) false/compliant because those algorithms test for 
As will be appreciated the present invention effectively minimum and maximum acceptable flow rates, respectively, 
reduces the CDVs of the higher frequency flows, without 5 More particularly, GCRA (1/MCR, x M c*d compliant 
materially increasing the CDVs of the lower frequency flows ma y not be receivin g output bandwidth that they 
flows. As a general rule, the CDV that is tolerable is a need to satisfy their MCR guarantees. Therefore, when such 
function of the negotiated rate for a flow For example, a f flow * ldcnUficd at 85 > ^ scheduler 62 and its steering 
CDV of 100 cell times is very large with respect to an *£!j? ™ * mbs& ^H ref " 

expected emission interval of one^ll every lOcells, but 10 tt^V f Ya™ °° * 

^ 11 • • c 4 . flL . j . J . . relatively high priority stalled virtual clock calendar queue 

generally iiisignificant if tte negoUated ennssion mterval is 88 for o^fat a rate somewhat in excess of its guaranteed 

only one cell every 2029 cells. MCR. For example, these subsequently received cell or 

When a calendar queue mechanism is employed to sched- packet references suitably are scheduled on the calendar 

ule the data transport units or cells of the different frequency queue 88 for emission at a rate that is determined by 

flows for transmission, the high frequency high priority 15 multiplying the MCR for the flow by a predetermined 

flows need to be resolved to the precision of a single cell speed-up factor. This causes the network to give these 

time while being scheduled to achieve an acceptably low additional potentially "lagging" flows the additional output 

CDV, but the low frequency/low priority flows can be more bandwidth that is needed to satisfy their MCR guarantees, 

coarsely resolved to a precision of, say, 16 cell times. This GCRA (1/MCR, T MC jd non-compliant ABR flows are 

means that the number of time slots on the calendar queue 20 further tested at 86 to determine whether they are demanding 

63 can be reduced. This enables the amount of memory that output service at acceptably low or unacceptably high 

is required to implement the calendar queue 63 to be reduced GCRA (1/PCR, Tpc/t) compliant or non-compliant rates, 

at the cost of losing some typically unneeded precision in the respectively. The results of this test are captured by another 

scheduling of the head of queue cells of the lower frequency control signal which is fed back to the scheduler 62 and its 

flows. 25 steering logic 87 to set them up for rate sensitive enqueuing 

It is to be understood that the frequency based prioritiza- of the subsequently received references to these GCRA 

tion technique which the present invention provides for (1/MCR, x MCJ ^ non-compliant flows on a lower priority 

resolving transmission conflicts at multiplex points among queue 89. Specifically, the subsequently received references 

flows of different nominally fixed frequencies may be 3Q to a flow that is found to be GCRA (1/PCR, Xp^ compliant 

employed in many different applications for reducing the at 86 are appended to the tail of the transmit list for the ABR 

relative jitter of the flows, including in applications having flows with MCR guarantees for it is serviced in round-robin 

work conserving per-flow output queues for feeding cells or order. Contrastingly, when a flow is found to be GCRA 

other data transport units into such a multiplex point. (1/PCR, Xp^ non-compliant at 86, the subsequently 

D. Traffic Shaping to MCR and PCR Parameters for ABR 3S received references for that flow are scheduled by the 

Service in Networks Having Source-to- Destination ABR scheduler 62 on a non-work conserving, stalled virtual clock 

Control Loops calendar queue 89 in accordance with the PCR for that flow, 

As will be recalled, the standard ABR traffic contract mcreb y ™P° sin Z a p CR Kmit on the flow, 

contemplates explicitly or implicitly specified PCR and More generally, it will be evident that the embodiment of 

MCR parameters, where MCR may equal 0. An ABR flow 40 ^ G 4 implements the following ABR traffic shaping algo- 

that conforms to its GCRA (1/MCR, t mcj J is valid and ntnm: 

entitled to service, but the network may not be giving the If GCRA (1/MCR, x^c«) compliant then enqueue in high 

flow the bandwidth to which it is entitled. Contrastingly, a priority queue at rate MCR*speedup 

flow which violates its GCRA (1/PCR, is non- else if GCRA (1/PCR, x^^) compliant then enqueue in 

conforming. Thus, ABR connections or flows that are routed 45 low-priority work conserving queue 

to the output of a network or network element, such as by the else enqueue in low-priority non-work conserving queue 

ATM switch 21, advantageously are shaped to ensure: (1) based on PCR emission interval, 

that the ABR flows with non-zero MCR guarantees receive However, alternatives that are based on similar and dif- 

adequate output bandwidth to effectively satisfy those guar- ferent principles will suggest themselves, 

antees; and (2) that none of the ABR flows violate their PCR 50 For example, as shown in FIG. 5, one potentially attrac- 

commitments at such output. In networks that have multiple tive alternative is to enqueue the references to the data 

multiplex points, it is useful to perform this shaping at each transport units or cells of flows that are found to be GCRA 

of the multiplex points. (1/MCR, x MC #) non-compliant and GCRA (1/PCR, Xp^ 

FIG. 4 illustrates one technique for shaping ABR flows or compliant at 85 and 86 (FIG. 4), respectively, in both (1) the 

VC connections to conform them to their traffic contracts at 55 high priority calendar queue 88 at a MCR scheduling 

an output of a network or network element. As shown, the interval, and (2) the work conserving region of the lower 

rates at which the respective flows are requesting output priority queue. This creates a "race" condition because 

service are monitored; first to determine at 85 whether the whenever one instance of such a dual queued reference is 

flows are or are not GCRA (1/MCR, x MCR ) compliant, and reached for service in either of the queues, a delinker 90 

then to determine at 86 whether the GCRA (1/MCR, x MCR ) 60 removes the other instance of that reference from the other 

non-compliant flows are or are not GCRA (1/PCR, Xp^ queue. This means that a tighter bound may be maintained 

compliant. Control signals reflecting the results of these on the tolerance, x. The traffic shaping algorithm of this 

cascaded tests 85 and 86 are fed back to the scheduler 62 and modified embodiment is: 

its associated steering logic 87 to permit appropriate rate At enqueue: 

shaping adjustments to be made to the rates at which the data 65 enqueue in high priority queue with rate MCR; 

transport units (e.g., cells) of the respective flows are fed to if GCRA (1/PCR, x^d compliant then enqueue in low- 

thc output. As will be appreciated, the desired state is for all priority work conserving queue; 
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else enqueue in low-priority non-work conserving queue R Traffic Shaping to PCR for UBR Service 

based on PCR emission interval; The embodiment of FIG. 4 can be simplified to shape 

At dequeue: traffic to a specified PCR for UBR service. UBR service 

if dequeuing from high priority queue then delink from templates an explicitly or implicitly specified PCR, but 

i^„ r • m ^Ti~-A-v \r cL < • i . . 5 no MCR. Thus, the provision made to enforce the ABR 

lowpnontyqueueelse dehnk from pnon y queue. MCR guarantee; may be eliminated, which means that the 
FIG 6 illustrates still another alternative for shaping ABR mcom ^ rcfcrcQCCS \ Q mc daU ^ QT cclJs f 

connections or flows. In this embodiment, the output band- UBR flow or connection may be enqueued on the queue 89 
width that is provided for each MCR non-comphant ABR m accordance with the flowing enqueuing rules: 
flow that has a non-zero MCR guarantee is dynamically if GCRA(l/PCR,T ra )compUant then enqueue in bucket 
adjusted based on the average spacing between ABR cells on 10 at en d of work conserving region 
the output link (i.e., at the transmit side of a line interface) cisc enqueue in non-work conserving region based on 

and the current length of the ABR "ready queue." The PCR emission interval, 

current length, Len, of this ABR "ready queue" conveniently What is claimed: 

is determined by measuring the length of the work conserv- 1. A traffic shaper in a packet switched communication 
ing queue on the ABR transmit lists 65e and 65/ as at 93. On 1S system for shaping a plurality of time multiplexed serial 
the other hand, the average spacing, S, between ABR cells flow of packets to corresponding unspecified bit rate net- 
on the calendar queue can be determining at 94 the percent work traffic contracts where the traffic contracts defines a 
of the link by dividing the bandwidth that is available for P eak packet emission rate, the traffic shaper comprising: 
ABR flows after allowance is made for any no n- ABR flows. a work conserving calendar queue for queuing entries for 
The bandwidth required by these non-ABR flows suitably is 20 transmission from said packet switched communication 
determined by computing at 94 the aggregate bandwidth system in a work-conserving manner; 

needed to service the transmit list 65 entries for the non- a non-work conserving calendar queue for queuing entries 
ABR flows. for transmission from said packet switched communi- 

For example, if it is determined at 94 that 50% of the cation system in a non work-conserving manner; and, 

bandwidth of the output link is available for the ABR flows, 25 a scheduler enqueuing packets of the given flow (i) on 
it follows that the average space, S, between ABR cells or ^ work conserving calendar queue when a rate at 

data transport units on the output link then is two cell times. which the packets are emitted from the traffic shaper is 

This information, together with the computed length, Len, of compliant with the unspecified bit rate traffic contract 

the ABR "ready queue," enables the service for the MCR fo ' lh ! & y * n flow ' ^ on ^ non - w <>rk conserving 

non-compliant ABR flows to be optimized by having the 30 CaIer ! dar ?* eue at a ™ te that * less than or substantially 
scheduler 62 schedule the incoming references for those T- k?u ^ ^ th u ™ te * 

flows on the non-work conserving calendar queue 89 at which Packets are emitted from the traffic shaper is 

respective emissions intervals T, of: non-compliant with the unspecified bit rate traffic con- 

' tract for the given flow. 

7>Min(s„ Max(P n R) (3) 35 2. The traffic shaper of claim 1, wherein said work 

conserving calendar queue and said non-work conserving 
Where: calendar queue are dynamically reallocated segments of a 

real time indexed data structure, said real-time indexed data 

R-an estimated round robin ABR service time (R-current structure being indexed by a pointer that cyclically traverses 
time+S*Len); ^ realtime indexed data structure as a function of real 

P ( =the earliest service contract compliant departure for time. 

the next cell of flow t (P,=current time+l/PCR); and 3. The traffic shaper of claim 2, wherein packets of the 

S,=the latest service contract compliant departure for the given flow have a uniform, fixed bit length, 
next cell of flow t (S,=current time+l/MCR). 4 - The traffic shaper of claim 1, wherein packets of the 

E. Traffic Shaping for Segmented ABR Connections 45 given flow are dequeued from said work conserving calen- 

As is known, ABR connections may operate with source- dar queue in approximate round robin order with respect to 
to-destination control loops, such as shown in FIG. 7 at 101, tne flows that have packets enqueued thereon, 
or with segmented control loops, such as shown in FIG. 8 at 5 - T° e traffic shaper of claim 4, wherein packets of the 
102. When segmented control loops are employed, each of given flow are fixed byte length cells for asynchronous 
the separately controlled segments functions as a virtual 50 transfer mode communications. 

source, VS, for the next segment. Thus, each ABR control The traffic shaper of claim 1, wherein each of said 

segment (except the first) is sourced by a virtual source packets is referenced by a pointer to said packet, and the 
which assumes the behavior of an ABR source endpoint. scheduler enqueues said packets on said work conserving 
Backward resource management (RM) cells are removed calendar queue and said non-work conserving calendar 
from the control loop when they are received by a virtual 55 queue by placing an entry to said pointer in one of said 
source. However, each source or virtual source can compute queues. 

an estimate of the available network bandwidth to its des- A traffic shaper in a packet switched communication 

tination or virtual destination, VD, based on this feedback system for shaping a plurality of time multiplexed serial 
which, in rum, can be expressed as an Allowed Cell Rate A° w of packets to corresponding unspecified bit rate net- 
(ACR) on a per-segment basis. Therefore, ABR traffic 60 worfc traffic contracts where the traffic contracts defines a 
shaping advantageously is carried out segment-by-segment peak packet emission rate, the traffic shaper comprising: 
for these ABR connections with segmented control loops, a work conserving calendar queue for queuing entries for 
using a maximum allowable per- flow data transport unit or transmission from said packet switched communication 

cell rate of Max(MCR, Min(ACR, PCR). The embodiments system in a work-conserving manner; 

of FIGS. 4-6 can implement such traffic shaping by setting 65 a non-work conserving calendar queue for queuing entries 
PCR' equal to Max(MCR, Min(ACR, PCR) and then by for transmission from said packet switched communi- 

using PCR' in place of PCR in the computations. cation system in a non work-conserving manner; and, 
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a scheduler for enqueuing packets of the given flow by which the packets are to be emitted from the switch is 

placing pointers to said packets (i) on said work con- compliant with an unspecified bit rate traffic contract 

serving calendar queue when a rate at which the for the given flow, and (ii) on said non-work conserving 

packets are emitted from the traffic shaper is compliant calendar queue when the rate at which the packets are 

with the unspecified bit rate traffic contract for the 5 t0 ^ emitted from the switch is non-compliant with 

given flow, and (ii) on said non-work conserving cal- ^ unspecified bit rate traffic contract for the given 

endar queue when the rate at which the packets are g QW 

emitted from the traffic sha^r is non^ompliant with 10 ^ of c , aim „ wherein me rafc . ^ which ^ 

the unspecified bit rate frame contract for the given , . 4 , i4 j r_ *i_ l ■ i- . 

g ow r & packets are to be emitted from the switch is compliant with 

8. The traffic shaper of claim 7 wherein the scheduler " * n bit ra * ^ contract when the Generic Cell 

enqueues packets on said non-work conserving queue at a Ra * nthm ** *** ^ * falsc * 

rate that is less than or substantially equal to the peak packet 11 ^ swilch of claun 9 whcrcm ^ n6iQ ^ P ackcts 

emission rate arc scheduled on said non-work conserving calendar queue 

9. A switch for a packet switched communication system is accc *ding to a peak cell rate emission interval, 
including a traffic shaper for serially emitting packets of 12 ^ switch of claim 9, wherein said work conserving 
multiple time multiplexed flows in substantial compliance calendar queue and said non-work conserving calendar 
with individual network traffic contracts for the respective queue are dynamically reallocated segments of a real time 
flows, at least one of said traffic contracts specifying an indexed data structure, said real-time indexed data structure 
unspecified bit rate network traffic contracts, where the 20 being indexed by a pointer that cyclically traverses said 
unspecified bit rate network traffic contracts defines a peak real-time indexed data structure as a function of real time, 
packet emission rate, the switch comprising: 13- The switch of claim 10, wherein packets of the given 

a work conserving calendar queue for queuing entries for flow , ha y e a ™iform f fixed bit length. 

transmission from said packet switched communication 14 ^ swltch of claun 9 » wherein packets of the given 

system in a work-conserving manner, 25 flow are dequeued from said work conserving calendar 

, * « - . queue in approximate round robin order with respect to the 

anon-workconservmgcalendar o^eue for q^ieumg entries flows ^ ued 

for transmission from said packet switched commum- 15 The of cUim u wherein ^ of ^ ^ veQ 

cation system in a non work-conserving manner; flow m fixed bytE length ^ for 4 nchronous tra ° sfer 

a queuing mechanism, said queuing mechanism organiz- 3Q mo de communications. 

ing pending packets in respective queues in accordance 16 ^ switch of claim 9 whcrein cach of said packets 

with an oldest pending packet at a head of queue order; ^ referenced by a pointer to said packet, and the scheduler 

anc *> enqueues said packets on said work conserving calendar 

a scheduling mechanism coupled to said queuing queue and said non-work conserving calendar queue by 

mechanism, for scheduling pending packets of the 35 placing an entry to said pointer in one of said queues, 
respective flows by placing pointers to said packets (i) 

on said work conserving calendar queue when a rate at ***** 
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